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This international preliminary examination report has been prepared bv this Inlemalional Preliminary l:.\nmmin« 
Authority and is transmitted to the applicanl according to Article 3<V 



2. This RKPORT consists of a total of 



sheets, including I his cover sheet. 



I I " IIR IC P° rl ,s n,so ^^nipanied by ANNKXKS. i.e.. sheets of the description, claims and/or drawings which have 
been amended and are the basis lor this report aiul/or sheets containing rectifications made before this Authority 
(sec Rule 70. 16 and Section 607 of the Administrative Instructions under the PCT). 

These annexes consist of a total ol" 



sheets. 
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I [^J Basis of the report 
II Q Priority 

III j~j Non-establishment of opinion with regard to novelty, inventive step and industrial applicability 

IV \^\ l' nc k of unity of invention 

V Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability: 

citations and explanations supporting such statement 

VI Certain documents cited 

Vil J j Certain defects in the international application 
VIM Certain observations on the international application 
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INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application No. 
PCT/FI00/00586 



I. Basis of the report 



I. Willi regard lo the elements of Hie international application:' 
fcxj Hie international application as original I v filed 

llie description: 

pages 

pages 

pages 



? as originally filed 



. filed willi the demand 



□ 



. filed with the letter of 



the claims: 

pages 

pages 

pages 

pages 



. as originally filed 

as amended (together with any statement) under article 1 9 

, filed with the demand 



1 | the drawings: 
pages 
pages 

pages 



filed with the letter ol' 



. as originally filed 



T filed with the demand 



the sequence listing part of the description: 
pages 

pages 
pages 



. filed with the letter of 



. as originally filed 



filed with the demand 



. filed with the letter of 



2. With regard to the langunne. all the elements marked above were available or furnished lo this Authority in the language in which 
the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language Engl i sh 



which is: 



I J lne language of a translation furnished for the purposes of international search (under Rule 23. 1(b)). 

[X] l h e language of publication of the international application (under Rule *IX.3(b)). 

f 1 the language of the translation furnished for the puiposcs of international preliminary examination (under Rules 55 2 and/ 
or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, the international 
preliminary examination was earned out on the basis of the sequence listing: 

| | contained in the international application in written form. 

| | filed together with the international application in computer readable form. 

| | furnished subsequently to this Authority in written form. 

| | furnished subsequently to this Authority in computer readable form. 

| J The statement that the subsequently furnished wrillen sequence lisling does not go beyond the disclosure in the 
international application as filed has Ixrcn furnished. 

□ I he statement that the information recorded in computer readable form is identical to the written sequence listing has 
been furnished. 

'I he amendments have resulted in the cancellation of: 
1 | the description, pages 
1 1 the claims, Nos. 

□ 

the drawings, sheet/fig 



5 I I 1 ,US re,H)rl luis hccu established as if (some ol) the amendments had not been made, since thev have been considered to go 
' beyond the disclosure as filed, as indicated in the Supplemental Hox (Rule 70.2 (c)).** 

Replacement sheets which have heen furnished lo the receiving Office in response to an invitation under Article N are referred to 
in this report as "originally filed" and are annexed to this report since thev do not contain amendments (littles 70 16 
and 7(1 17). 

Any replacement sheet containing such amendments must he referred to under item I and annexed to this report. 
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V. Reasoned statement under Article 35(2) with regard tit nuvelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 

1 . Statement 

Novelty (N) Claims 1-5 yi:S 

Claims NO 

Inventive step (IS) Claims 1-5 YKS 

Claims NO 

Industrial applicability (IA) Claims "1-5 YKS 

Claims NO 



2. Citations and explanations (Rule 70.7) 

Cited documents: 

1 . CHAUR-HEH HSIEH ET AL "Fast Search Algorithms for Vector 
Quantization of Images Using Multiple Triangle Inequalities 
and Wavelet Transform" 

2. US 57688629 A (Wise) 

3. EP 0964583 A2 (Texas) 

The documents cited in the International Search Report 
represent background art. 

The invention defined in claims 1-5 is not disclosed by any of 
these documents. 

None of the cited documents gives any indication towards the 
claimed method and apparatus for motion estimation, whereby 
the image blocks included in the search area are arranged in a 
predetermined order on the basis of the image block average 
values of the image blocks in question, and whereby a 
directory memory of an associate memory as well as a partial 
distance elimination method (for searching a best match) is 
utilised. No relevant combination of the cited documents would 
lead a person skilled in the art to the invention defined in 
the claims. 

Therefore, the invention defined in claims 1-5 is novel and is 
considered to involve an inventive step. It is also considered 
to be industrially applicable. 
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MERCHANT & GOULD P.C. 



United States Patent Application 
COMBINED DECLARATION AND POWEROF ATTORNEY 

As a below named inventor I hereby declare that: my residence, post office address and citizenship are as stated below next to my 
name; that 

I verily believe I am the original, first and sole inventor (if only one name is listed below) or a joint inventor (if plural inventors 
are named below) of the subject matter which is claimed and for which a patent is sought on the invention entitled: 
PROCEDURE AND SYSTEM FOR PERFORMING MOTION ESTIMATION 

The specification of which 

a. Q] is attached hereto 

b. ^ was filed on as application serial no. and was amended on (if applicable) (in the case of a PCT-filed application) 
described and claimed in international no. PCT/FI00/00586 filed June 28, 2000 and as amended on (if any), which I have reviewed and 
for which I solicit a United States patent. 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the claims, as amended by 
any amendment referred to above. 

I hereby claim foreign priority benefits under Title 35, United States Code, § 1 19/365 of any foreign application(s) for patent or inventor's 
certificate listed below and have also identified below any foreign application for patent or inventor's certificate having a filing date before 
that of the application on the basis of which priority is claimed: 



a. Q no such applications have been filed. 

b. ^ such applications have been filed as follows: 



FORI 


:iCN APPLICATION(S), IF ANY, CLAIMING PRIORITY UNDER 35 USC § 


119 


COUNTRY 


APPLICATION NUMBER 


DATE OF FILING 
(day, month, year) 


DATE OF ISSUE 
(day, month, year) 


Finland 


991469 


June 28, 1999 




ALL FORE 


IGN APPLICATION(S), IF ANY, FILED BEFORE THE PRIORITY APPLIC 


'ATION(S) 


COUNTRY 


APPLICATION NUMBER 


DATE OF FILING 
(day, month, year) 


DATE OF ISSUE 
(day, month, year) 











I hereby claim the benefit under Title 35, United States Code, § 120/365 of any United States and PCT international application(s) listed 
below and, insofar as the subject matter of each of the claims of this application is not disclosed in the prior United States application in the 
manner provided by the first paragraph of Title 35, United States Code, § 1 12, 1 acknowledge the duty to disclose material information as 
defined in Title 37, Code of Federal Regulations, § 1.56(a) which occurred between the filing date of the prior application and the national 
or PCT international filing date of this application. 



| U.S. APPLICATION NUMBER 


DATE OF FILING (day, month, year) 


STATUS (patented, pending, abandoned) 









I hereby claim the benefit under Title 35, United States Code § 1 19(e) of any United States provisional application(s) listed below: 



U.S. PROVISIONAL APPLICATION NUMBER 


DATE OF FILING (Day, Month, Year) 







I acknowledge the duty to disclose infOTnation that is material to the patentability of tnS^plication in accordance with Title 37, Code of 
Federal Regulations, § 1 .56 (reprinted below): 



§ 1.56 Duty to disclose information material to patentability. 

(a) A patent by its very nature is affected with a public interest. The public interest is best served, and the most effective 
patent examination occurs when, at the time an application is being examined, the Office is aware of and evaluates the teachings of all 
information material to patentability. Each individual associated with the filing and prosecution of a patent application has a duty of candor 
and good faith in dealing with the Office, which includes a duty to disclose to the Office all information known to that individual to be 
material to patentability as defined in this section. The duty to disclose information exists with respect to each pending claim until the 
claim is canceled or withdrawn from consideration, or the application becomes abandoned. Information material to the patentability of a 
claim that is canceled or withdrawn from consideration need not be submitted if the information is not material to the patentability of any 
claim remaining under consideration in the application. There is no duty to submit information which is not material to the patentability of 
any existing claim. The duty to disclose all information known to be material to patentability is deemed to be satisfied if all information 
known to be material to patentability of any claim issued in a patent was cited by the Office or submitted to the Office in the manner 
prescribed by §§ 1.97(b)-(d) and 1.98. However, no patent will be granted on an application in connection with which fraud on the Office 
was practiced or attempted or the duty of disclosure was violated through bad faith or intentional misconduct. The Office encourages 
applicants to carefully examine: 

(1) prior art cited in search reports of a foreign patent office in a counterpart application, and 

(2) the closest information over which individuals associated with the filing or prosecution of a patent application 
believe any pending claim patentably defines, to make sure that any material information contained therein is disclosed to the Office. 

(b) Under this section, information is material to patentability when it is not cumulative to information already of record or 
being made of record in the application, and 

(1) It establishes, by itself or in combination with other information, a prima facie case of unpatentability of a claim; 

or 

(2) It refutes, or is inconsistent with, a position the applicant takes in: 

(i) Opposing an argument of unpatentability relied on by the Office, or 

(ii) Asserting an argument of patentability. 

A prima facie case of unpatentability is established when the information compels a conclusion that a claim is unpatentable under the 
preponderance of evidence, burden-of-proof standard, giving each term in the claim its broadest reasonable construction consistent with the 
specification, and before any consideration is given to evidence which may be submitted in an attempt to establish a contrary conclusion of 
patentability. 

(c) Individuals associated with the filing or prosecution of a patent application within the meaning of this section are: 

(1) Each inventor named in the application: 

(2) Each attorney or agent who prepares or prosecutes the application; and 

(3) Every other person who is substantively involved in the preparation or prosecution of the application and who is 
associated with the inventor, with the assignee or with anyone to whom there is an obligation to assign the application. 

(d) Individuals other than the attorney, agent or inventor may comply with this section by disclosing information to the 
attorney, agent, or inventor. 

(e) In any continuation-in-part application, the duty under this section includes the duty to disclose to the Office all 
information known to the person to be material to patentability, as defined in paragraph (b) of this section, which became available between 
the filing date of the prior application and the national or PCT international filing date of the continuation-in-part application. 
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I hereby appoint the following attorneys) and/or patent agent(s) to prosecute this apph^^n and to transact all business in the Patent and 
Trademark Office connected herewith: 



Albrecht, John W. 
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Qualey, Terry 
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Reich, John C. 
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Reg. No. 25,767 


DiPietro, Mark J. 
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Reg. No. P-48,229 


Kettelberger, Denise 


Reg. No. 33,924 


Williams, Douglas J. 
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Reg. No. 38,946 


Young, Thomas 
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I hereby authorize them to act and rely on instructions from and communicate directly with the person/assignee/attorney/firm/ organization 
who/which first sends/sent this case to them and by whom/which I hereby declare that I have consented after full disclosure to be 
represented unless/until I instruct Merchant & Gould P.C. to the contrary. 

I understand that the execution of this document, and the grant of a power of attorney, does not in itself establish an attorney-client 
relationship between the undersigned and the law firm Merchant & Gould P.C, or any of its attorneys. 
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Please direct all correspondence in this case to Merchant & Gould P.C. at the address indicat ed below: 

Merchant & Gould P.C. 
P.O. Box 2903 
Minneapolis, MN 55402-0903 



I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and belief are 
believed to be true; and further that these statements were made with the knowledge that willful false statements and the like so made are 
punishable by fine or imprisonment, or both, under Section 1001 of Title 18 of the United States Code and that such willful false statements 
may jeopardize the validity of the application or any patent issued thereon. 
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MENETELMA JA JAR JESTELMA LUKE- ESTIMOINNIN 

SUORITTAMISEKSI 

KEKSINNON ALA 

Keksinto liittyy videokuvan kompressointiin . 
5 Erityisesti keksinto liittyy uuteen ja kehittyneeseen 
menetelmaan ja j ar j estelmaan liike-estimoinnin suorit- 
tamiseksi videokuvan kompressoinnin yhteydessa. 

TEKNIIKAN TASO 

10 Entuudestaan tunnetaan useita menetelmia vi- 

deokuvan kompressoimiseksi . Useimmiten naiden menetel- 
mien eniten aikaa ja laskentatehoa vaativa osa-alue on 
liike-estimointi . Liike-estimoinnin periaate on seu- 
raavanlainen . Videokuva koostuu aikatasossa perakkai- 

15 sista kuvakehyksista . Kukin kuvakehys on jaoteltu tie- 
tyn kokoisiin kuvalohkoihin . Tyypillisest i kuvalohko 
on esimerkiksi 8x8 kuvapisteen kokoinen. Koodattaes- 
sa kuvakehysta esimerkiksi lahetysta varten sita kasi- 
tellaan kuvalohko kerrallaan. Kuitenkin sen sijaan 7 

2 0 etta jokaisen kuvakehyksen jokainen kuvalohko lahetet- 
taisiin sellaisenaan, pyritaankin ensin etsimaan edel- 
lisesta kuvakehyksesta kasiteltavana olevan kuvalohkon 
ymparistosta, niin sanotulta hakualueelta , joko taysin 
vastaavaa tai tietyissa rajoissa tarpeeksi lahella 

25 olevaa kuvalohkoa. Mikali tallainen kuvalohko loytyy, 
lahetetaan kokonaisen lohkoinf ormaation sijaan vain 
pelkka liikevektori , ts . vektori, joka ilmoittaa 16y- 
detyn lohkon sijainnin suhteessa alkuperaiseen loh- 
koon. Lahetettavan inf ormaation maara vahenee siis 

30 huomattavasti . 

Eras toinen videokompressoinnin yhteydessa 
kaytetty menetelma on vektorikvantisointi . Se eroaa 
liike-estimoinnista siina, etta koodattavalle lohkolle 
etsitaan vastinetta ennalta maaratysta koodikir j asta 

35 sen sijaan, etta sita etsittaisiin edellisesta kuvake- 
hyksesta. Koodikir ja on tyypillisest i kokoelma ylei- 
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simmin esiintyvia ki^alohkoja . Samaa koodikirjaa kay- 
tetaan luonnollisest i seka enkooderissa etta dekoode- 
rissa . 

Vaikka liike-est imoinnilla ja vektorikvan- 
5 tisoinnilla saadaan lahettavan inf ormaat ion maaraa 
pienennettya merkittavasti, aiheutuu niista kuitenkin 
omat ongelmansa. Tyypillisesti varsinkin etsintavaihe 
on aikaa vieva. Etsinnan kompleksisuus kasvaa suhtees- 
sa hakualueen sivun pituuden nelioon. Taman vuoksi on 

10 pyritty kehittamaan erilaisia menetelmia, joilla et- 
sintaa saataisiin nopeutettua. Seuraavissa julkaisuis- 
sa on tuotu esiin esimerkkeja menetelmista , jotka pyr- 
kivat nopeuttamaan liike-estimointia tai vektorikvan- 
tisointia joko keskittymalla etsintaalgoritmien tehos- 

15 tamiseen tai joillakin muilla keinoin: S. T. Valli,- 
"Very Low Bitrate Coding Using Hierarchical Classified 
VQ and Cluster Based Segmentation of Motion Informati- 
on", paper No. 7.3, VLBV94 , University of Essex, UK, 
April 19 94; H. Li, A. Lundmark, R. Forchheimer, 11 Image 

2 0 Sequence Coding at Very Low Bitrates : A Review", IEEE 

Transactions on Image Processing, Vol.3, No. 5, Septem- 
ber 1994; H. Abut, ed . , "Vector Quantization", IEEE 
Press, 1990; G. Poggi , "Fast Algorithm for Full-Search 
VQ Encoding", Electronic Letters, Vol.29, No. 123, June 
25 1993; C.-M. Huang, Q. Bi, G. S. Stiles, R. W. Harris, 
"Fast Full Search Equivalent Encoding Algorithms for 
Image Compression Using Vector Quantization" , IEEE 
Transactions on Image Processing, Vol.1, No . 3 , July 
1992 . 

3 0 Nykyisilla menetelmilla hakualue on maksimis- 

saan tyypillisesti + 15 kuvapistetta koodattavan loh- 
kon origosta. Jo talloinkin etsinta on niin komplek- 
sista, ettei sen suorittaminen oh j elmallisesti ole 
yleensa enaa mahdollista, vaan joudutaan kayttamaan 
35 kalliita laitteistopohj aisia ratkaisuja, kuten erityi- 
sia signaalinkasittelypiireja . Kuitenkin erilaisten 
alhaisen siirtonopeuden/alhaisen kuvataajuuden sovel- 
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lusten yhteydessa mainittua + 15 kuvapistetta suurem- 
matkip siirtymat ovat yleisia liikkeen aikana. Tarvet- 
ta nykyista tehokkaammille menetelmille siis on. 

Esilla olevan keksinnon tarkoituksena on tuo- 
5 da esiin uudenlainen menetelma ja j ar j estelma , joka 
poistaa edella mainitut epakohdat . Erityisesti tarkoi- 
tuksena on tuoda esiin menetelma ja jarjestelma, joka 
mahdollistaa liike-estimoinnin suorittamisen ohj elmal - 
lisesti tavallisessa PC-ymparistossa , ja kuitenkin sa- 
10 manaikaisesti aiempaa tehokkaammin . 

KEKSINNON YHTEENVETO 

Esilla olevan keksinnon mukainen menetelma 
liike-estimoinnin suorittamiseksi videokuvan kompres- 

15 soinnissa kasittaa seuraavat vaiheet . Kuvakehyksesta N 
maaritetaan kuvalohko, joka halutaan koodata. Mainit- 
tua kuvakehysta N edeltavasta kuvakehyksesta N-l maa- 
ritetaan kyseisen kuvalohkon sijaintia vastaava liike- 
vektoreiden hakualue . Kuvalohkokeskiarvot maaritetaan 

20 kaikissa mahdollisissa mainitun hakualueen sisaltamis- 
sa kuvalohko j en si j aint ikohdissa ennalta maaratyn suu- 
ruisella siirtymalla. Taman jalkeen jarjestetaan ky- 
seisen hakualueen sisaltamat kuvalohkot kyseisten ku- 
valohko j en kuvalohkokeskiarvo j en perusteella ennalta 

2 5 maarattyyn j ar j estykseen . Entuudestaan tunnettua on 

suorittaa edella mainittu jarjestely kayttaen apuna 
erilaisia j ar j estelyalgoritme j a (sorting algorithm) . 
Kyseisten algoritmien haittana on kuitenkin niiden hi- 
taus. Seuraavaksi etsitaan kyseisen hakualueen kuva- 
30 lohkoista vaihtoehto, joka parhaiten vastaa koodatta- 
vana olevaa kuvalohkoa. Paras vastaavuus voidaan maa- 
rittaa esimerkiksi minimivirheen avulla, ts . lohkot, 
joiden valinen virhe on pienin, vastaavat parhaiten 
toisiaan . 

3 5 Kuvalohkokeskiarvo j en maarittamisella tarkoi- 

tetaan tassa yhteydessa sita, etta edullisesti haetaan 
jo edellisia kuvalohko j a koodattaessa lasketut ja tal- 
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lennetut kuvalohkokeskiarvot erityisesta kuvalohkokes- 
kiarvomuistista . Tama on mahdollista siksi, etta koo- 
dattavalle kuvalohkolle maaritetty hakualue on tyypil- 
lisesti osittain sama kuin edellisia koodattuja kuva- 
5 lohkoja vastanneet hakualueet, joilla kuvalohkokes- 
kiarvojen maarittaminen ja tallennus kyseiseen muis- 
tiin on jo tapahtunut . Jos kuitenkaan liike- 
estimointia ei ole kaytetty edellisia kuvalohkoja koo- 
dattaessa, tai jos kuval ohkoke sk i arvoa ei muusta syys- 

10 ta loydy valmiina mainitusta muistista, kuvalohkokes- 
kiarvo lasketaan ja tallennetaan kyseiseen muistiin. 

Edella kuvatussa edullisessa menettelyssa ku- 
vakehyksen N-l kuvalohkokeskiarvo j a lasketaan ja tal- 
lennetaan sita mukaa kun kuvakehyksen N kuvalohkoja 

15 koodataan. Kuvalohkokeskiarvot voidaan kuitenkin las- 
kea ja tallentaa myds kerralla ennen kuvalohkojen koo- 
dausta. Tama ei ole kuitenkaan yleensa edullista sik- 
si, etta kuvalohkokeskiarvo j en laskentaa edellyttavaa 
liike-estimointia ei valttamatta suoriteta kaikkia ku- 

2 0 valohkoja koodattaessa . 

Keksinnon mukaisesti hakualueen sisaltamat 
kuvalohkot jarjestetaan tallentamalla kyseisten kuva- 
lohkojen kuvalohkokeskiarvot assosiat iivisen muistiva- 
lineen hakemistomuist in muistipaikkoihin nousevaan tai 

25 laskevaan j ar j estykseen, seka tallentamalla hakemisto- 
muistin kutakin muist ipaikkaa vastaavaan antomuistin 
muistipaikkaan niiden kuvalohkojen si j aintitiedot , 
joiden kuvalohkokeskiarvo vastaa kyseiseen hakemisto- 
muistin muistipaikkaan tallennettua arvoa. Mainitun 

30 assosiatiivisen muistivalineen avainsanana kaytetaan 
koodattavan kuvalohkon kuvalohkokeskiarvoa . 

Assosiatiivisella muist ivalineel la tarkoite- 
taan tassa digitaalista muistivalinetta, kuten esimer- 
kiksi muistipiiria, jossa normaali osoit teendekoodaus - 

35 logiikka on korvattu erityisella hakemistomuistilla 
(directory memory) . Hakemistomuist i koostuu muist ipai- 
koista, joihin kuhunkin on tallennettu esimerkiksi 
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tietty merkkijono. Lisaksi assosiatiiviseen muistiva- 
lineeseen kuuluu antomuisti (output memory) , jonka 
muistipaikkoihin varsinainen data on tyypillisesti 
tallennettu. Kukin antomuistin muistipaikka on assosi- 
5 oitu yhden tai useamman hakemistomuist in muistipaikan 
kanssa. Muistille annetaan syotteena tietty avainsana 
(key word) , joka on esimerkiksi merkkijono. Jos hake- 
mistomuistin jostakin muistipaikasta loytyy vastine 
(matching tag) avainsanalle, saadaan tulosteena kysei- 

10 sen hakemistomuistin muistipaikkaa vastaavan antomuis- 
tin muistipaikan sisalto. Esimerkki assosiatiivisesta 
muistivalineesta on CAM-muisti (Content Addressable 
Memory, CAM) . Assosiatiivista muistivalinetta on esi- 
telty tarkemmin esimerkiksi julkaisussa T. Kohonen, 

15 "Self -Organization and Associative Memory", Springer- 
Verlag, 1984. 

Edelleen keksinnon mukaisesti kasiteltavien 
kuvalohkojen joukkoa rajoitetaan keskimaaraisen vir- 
heen perusteella seuraavan yhtalon mukaisesti: 

20 r^^ifc-fil^Z)^}, jossa 

Y A on kasiteltavien kuvalohkojen rajoitettu 

joukko, 

y i on kuvalohkoehdokas i, 

% x on koodattavan kuvalohkon kuvalohkokes- 

25 kiarvo, 

on kuvalohkoehdokkaan i kuvalohkokeskiar- 

vo, ja 

D min on parhaan kuvalohkoehdokkaan virhe kuva- 
pistetta kohti . 

3 0 D min voidaan laskea esimerkiksi RMS-virheena 

tai MAD-virheena (Root -Mean- Squared, RMS; Mean- 
Absolute-Distortion, MAD) . Rajoittamista keskimaarai- 
sen virheen perusteella on tarkasteltu yksityiskohtai- 
semmin esimerkiksi edella mainituissa julkaisuissa C- 

35 M. Huang, Q. Bi, G. S. Stiles, R. W. Harris, "Fast 
Full Search Equivalent Encoding Algorithms for Image 
Compression Using Vector Quantization", IEEE Transac- 
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tions on Image Processing, Vol.1, No . 3 , July 1992 seka 
G. Poggi, "Fast Algorithm for Full-Search VQ Enco- 
ding", Electronic Letters, Vol.29, No. 123, June 1993. 

Edelleen keksinnon mukaisesti kyseiseen ra- 
5 joitettuun joukkoon kuuluvista kuvalohkoista etsitaan 
paras vaihtoehto PDE-menetelmaa (Partial Distance Eli- 
mination, PDE) kayttamalla. PDE-menetelma on sinansa 
tunnettu menetelma, jota kaytetaan esimerkiksi vekto- 
rikvantisoinnissa etsinnan nopeuttamiseen . Virhe koo- 

10 dattavan kuvalohkon ja kunkin kuvalohkoehdokkaan va- 
lilla lasketaan normaalisti kuvapiste kuvapisteelta . 
Jos virhe ylittaa siihenastisen minimivirheen, lasken- 
ta lopetetaan ja siirrytaan suorittamaan vertailua 
seuraavaan kuvalohkoehdokkaaseen . 

15 Keksinnon eraassa sovelluksessa hakualueena 

kaytetaan ennalta maarattya saannollisen muotoista 
aluetta koodattavan kuvalohkon ymparilta. Tyypillises- 
ti hakualue on esimerkiksi nelikulmion muotoinen. 

Keksinnon eraassa sovelluksessa maaritetaan 

20 alue, joka muodostuu yhden tai useamman perakkaisten 
kuvakehysten valilla nopeasti liikkuvan kohteen kasit- 
tamasta alueesta, ja kaytetaan mainittua aluetta haku- 
alueena . 

Keksinnon eraassa sovelluksessa kuvalohkojen 
25 mahdolliset si j aintikohdat maaritetaan yhden kuvapis- 
teen, kuvapisteen puolikkaan tai muun murto-osan siir- 
tymalla . 

Esilla olevan keksinnon etuna tunnettuun tek- 
niikkaan verrattuna on, etta se nopeuttaa liike- 

30 estimointia huomattavasti , ja siten mahdollistaa Hi- 
ke -est imoinnin suorittamisen ohj elmallisesti tavalli- 
sessa PC-ymparistossa, ja kuitenkin samanaikaisesti 
aiempaa tehokkaammin . Koska liike-estimointi voidaan 
suorittaa ohj elmallisesti , kalliita laitepohj aisia 

35 ratkaisuja ei tarvita, ja siten keksinnon myota liike- 
estimointi muuttuu myos aiempaa edullisemmaksi . 
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KUVALUETTELO 

Seuraavassa keksintoa selostetaan oheisten 
sovellusesimerkkien avulla viittaamalla oheiseen pii- 
rustukseen, jossa 

kuviossa 1 on lohkokaaviomaisesti kuvattu 
eras keksinnon mukainen jar jestelma. 

KEKSINNON YKS I TY I S KOHT AINEN SELOSTUS 

Kuviossa 1 on kuvattu eraan keksinnon mukai- 
sen jarjestelman komponentit. Jar jestelma on toteutet- 
tu esimerkiksi ohj elmallisina komponentteina tavalli- 
seen PC- tietokoneeseen . Jar j estelmaan kuuluu maaritte- 
lyvalineet 1, joilla maaritetaan kuvalohkokeskiarvot 
koodattavan kuvalohkon sijaintia vastaavan hakualueen 
sisal tamissa kuvalohko j en si j aint ikohdissa , j ar j este- 
lyvalineet 2, joilla jarjestetaan kuvalohkot niiden 
kuvalohkokeskiarvojen perusteella ja etsintavalineet 
3, joilla etsitaan kuvalohkoista vaihtoehto, joka par- 
haiten vastaa koodattavana olevaa kuvalohkoa. Maarit- 
telyvalineet 1 kasittavat kuvalohkokeskiarvomuistin 
(ei esitetty) , johon lasketut kuvalohkokeskiarvot tal- 
lennetaan, ja josta niita tarvittaessa haetaan. Kay- 
tannossa kuvalohkokeskiarvomuist i voi olla esimerkiksi 
tietty osa PC- tietokoneen muist iavaruutta . 

Keksinnon mukaisesti j arj estelmaan kuuluu 
CAM-muisti 2, jonka avulla kuvalohkot jarjestetaan 
tallentamalla niiden kuvalohkokeskiarvot hakemisto- 
muistin muist ipaikkoihin nousevaan tai laskevaan jar- 
jestykseen ja tallentamalla hakemistomuistin kutakin 
muistipaikkaa vastaavaan antomuistin muist ipaikkaan 
niiden kuvalohkojen si j aintit iedot , joiden kuvalohko- 
keskiarvo vastaa kyseiseen hakemistomuistin muisti- 
paikkaan talletettua arvoa. Kaytannossa CAM-muisti 2 
on edullisesti tietty osa PC- tietokoneen muistiava- 
ruutta, mutta se voi olla myos esimerkiksi erillinen 
muistipiiri. Edelleen keksinnon mukaisesti jarjestel- 
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maan kuuluu valineet 3, joilla rajoitetaan kasitelta- 
vien kuvalohkojen joukkoa keskimaaraisen virheen pe- 
rusteella, ja valineet 3, joilla etsitaan kyseiseen 
rajoitettuun joukkoon kuuluvista kuvalohkoista paras 
5 vaihtoehto PDE-menetelmaa kayttamalla. 

Kuvakehyksesta N maaritetaan kuvalohko, joka 
halutaan koodata. Mainittua kuvakehysta N edeltavasta 
kuvakehyksesta N-l maaritetaan kyseisen kuvalohkon si- 
jaintia vastaava liikevektoreiden hakualue. Kuvalohko- 

10 keskiarvot maaritetaan kaikissa mahdollisissa mainitun 
hakualueen sisaltamissa kuvalohko j en si j aint ikohdissa 
ennalta maaratyn suuruisella siirtymalla, kuten esi- 
merkiksi yhden kuvapisteen, kuvapisteen puolikkaan tai 
muun murto-osan siirtymalla. Taman jalkeen jarjeste- 

15 taan kyseiset kuvalohkot ennalta maarattyyn jarjestyk- 
seen niiden kuvalohkokeskiarvoj en perusteella, seka 
etsitaan kyseisen hakualueen kuvalohkoista vaihtoehto, 
joka parhaiten vastaa koodattavana olevaa kuvalohkoa. 
Paras vastaavuus voidaan maarittaa esimerkiksi minimi - 

20 virheen avulla, ts. lohkot, joiden valinen virhe on 
pienin, vastaavat parhaiten toisiaan. 

Kaytannossa kuvalohkokeskiarvoj en maarittami - 
nen tapahtuu edullisesti hakemalla jo edellisia kuva- 
lohko j a koodattaessa lasketut ja tallennetut kuvaloh- 

25 kokeskiarvot erityisesta kuvalohkokeskiarvomuistista . 
Tama on mahdollista siksi, etta koodattavalle kuvaloh- 
kolle maaritetty hakualue on tyypillisesti osittain 
sama kuin edellisia koodattuja kuvalohkoja vastanneet 
hakualueet , joilla kuvalohkokeskiarvoj en maarittaminen 

30 ja tallennus kyseiseen muistiin on jo tapahtunut . Jos 
liike-estimointia ei kuitenkaan ole kaytetty edellisia 
kuvalohkoja koodattaessa, tai jos kuvalohkokeskiarvoa 
ei muusta syysta loydy valmiina mainitusta muistista, 
kuvalohkokeskiarvo lasketaan ja tallennetaan kyseiseen 

35 muistiin . 

Edella kuvatussa edullisessa menettelyssa ku- 
vakehyksen N-l kuvalohkokeskiarvoj a lasketaan ja tai- 
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lennetaan sita mukaa kun kuvakehyksen N kuvalohkoja 
koodataan. Kuvalohkokeskiarvot voidaan kuitenkin las- 
kea ja tallentaa myos kerralla ennen kuvalohkojen koo- 
dausta. Tama ei ole kuitenkaan yleensa edullista sik- 
5 si, etta kuvalohkokeskiarvo j en laskentaa edellyttavaa 
liike-estimointia ei valttamatta suoriteta kaikkia ku- 
valohko j a koodattaessa . 

Keksinnon mukaisesti kuvalohkot jarjestetaan 
tallentamalla niiden kuvalohkokeskiarvot CAM-muistin 2 

10 hakemistomuistin muist ipaikkoihin nousevaan tai laske- 
vaan j ar j estykseen . Edelleen hakemistomuistin kutakin 
muist ipaikkaa vastaavaan antomuistin muist ipaikkaan 
tallennetaan niiden kuvalohkojen si j aintitiedot , joi- 
den kuvalohkokeskiarvo vastaa kyseiseen hakemistomuis- 

15 tin muistipaikkaan talletettua arvoa . CAM-muistin 2 
avainsanana kaytetaan koodattavan kuvalohkon kuvaloh- 
kokeskiarvoa . 

Hakualueena kaytetaan ennalta maarattya saan- 
nollisen muotoista aluetta koodattavan kuvalohkon ym- 

20 parilta. Hakualue on esimerkiksi nelikulmion muotoi- 
nen. Vaihtoehtoisesti hakualue voi olla myos alue, jo- 
ka muodostuu yhden tai useamman perakkaisten kuvake- 
hysten valilla nopeasti liikkuvan objektin kasittamas- 
ta alueesta . 

25 Keksintoa ei rajata pelkastaan edella esitet- 

tyja sovellusesimerkke ja koskevaksi, vaan monet muun- 
nokset ovat mahdollisia pysyttaessa patenttivaatimuk- 
sien maaritteleman keksinnollisen ajatuksen puitteis- 
sa. Eras tallainen muunnos on kuvatun keksinnon kayt- 

3 0 taminen toisiaan vastaavien kuvalohkojen etsimiseen 
stereokuvaparin (vasemman- ja oikeanpuoleisten) kuvien 
valilla. Tata liike-estimoinnille laheista menettelya 
on kuvattu esimerkiksi julkaisussa I. Dinstein et al . , 
"On the Compression of Stereo Images: Preliminary Re- 

35 suits", Signal Processing 17 (1989), s. 373-382. 



0 
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PATENTTIVAATIMUKSET 

1. Menetelma liike-estimoinnin suorittamisek- 
si videokuvan kompressoinnissa , joka menetelma kasit- 
taa seuraavat vaiheet : 
5 maaritetaan koodattava kuvalohko kuvakehyk- 

sesta N, 

maaritetaan kyseisen kuvalohkon sijaintia 
vastaava hakualue kuvakehyksesta N-l, 

maaritetaan kuvalohkokeskiarvot kyseisen ha- 
10 kualueen sisaltamissa kuvalohko j en si j aintikohdissa 
ennalta maaratyn suuruisella siirtymalla, 

jarjestetaan kyseisen hakualueen sisaltamat 
. kuvalohkot kyseisten kuvalohko j en kuvalohkokeskiarvo- 
jen perusteella ennalta maarattyyn jar jestykseen, ja 
15 etsitaan kyseisen hakualueen kuvalohkoista 

vaihtoehto, joka parhaiten vastaa koodattavana olevaa 
kuvalohkoa, tunnettu siita, etta menetelma edel- 
leen kasittaa vaiheet : 

jarjestetaan hakualueen sisaltamat kuvalohkot 

2 0 tallentamalla kyseisten kuvalohkojen kuvalohkokeskiar- 

vot assosiatiivisen muistivalineen hakemistomuistin 
muistipaikkoihin nousevaan tai laskevaan jarjestyk- 
seen, seka tallentamalla hakemistomuistin kutakin 
muistipaikkaa vastaavaan antomuistin muistipaikkaan 
25 niiden kuvalohkojen si j aintitiedot , joiden kuvalohko- 
keskiarvo vastaa kyseiseen hakemistomuistin muisti- 
paikkaan talletettua arvoa, 

kaytetaan kyseisen assosiatiivisen muistiva- 
lineen avainsanana koodattavan kuvalohkon kuvalohko- 

3 0 keskiarvoa, 

rajoitetaan kasiteltavien kuvalohkojen jouk- 
koa keskimaaraisen virheen perusteella, ja 

etsitaan kyseiseen rajoitettuun joukkoon kuu- 
luvista kuvalohkoista paras vaihtoehto PDE-menetelmaa 
35 kayttamalla. 
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2. Patenttivaatimuksen 1 mukainen menetelma, 
tunnettu siita, etta menetelma edelleen kasittaa 
vaiheen : 

kaytetaan hakualueena ennalta maarattya saan- 
5 nollisen muotoista aluetta koodattavan kuvalohkon ym- 
parilta . 

3. Patenttivaatimuksen 1 mukainen menetelma, 
tunnettu siita, etta menetelma edelleen kasittaa 
vaiheet : 

10 maaritetaan alue, joka muodostuu yhden tai 

useamman perakkaisten kuvakehysten valilla nopeasti 
liikkuvan kohteen kasittamasta alueesta, ja 

kaytetaan mainittua aluetta hakualueena. 

4. Jonkin patenttivaatimuksista 1-3 mukai- 
15 nen menetelma, tunnettu siita, etta menetelma 

edelleen kasittaa vaiheen: 

maaritetaan kuvalohkojen mahdolliset sijain- 
tikohdat yhden kuvapisteen, kuvapisteen puolikkaan tai 
muun murto-osan siirtymalla. 
20 5. Jarjestelma liike-est imoinnin suorittami- 

seksi videokuvan kompressoinnissa, joka jarjestelma 
kasittaa : 

maarittelyvalineet (1) , joilla maaritetaan 
kuvalohkokeskiarvot koodattavan kuvalohkon si j aint ia 
25 vastaavan hakualueen sisaltamissa kuvalohkojen sijain- 
tikohdissa ennalta maaratyn suuruisella siirtymalla 
kyseisen koodattavan kuvalohkon sisaltavaa kuvakehysta 
edeltavasta kuvakehyksesta , 

jar jestelyvalineet (2) , joilla jarjestetaan 
3 0 kuvalohkot kyseisten kuvalohkojen kuvalohkokeskiarvo- 
jen perusteella, ja 

etsintavalineet (3) , joilla etsitaan kuvaloh- 
koista vaihtoehto, joka parhaiten vastaa koodattavana 
olevaa kuvalohkoa, tunnettu siita, etta jarjes- 
35 telma edelleen kasittaa: 

assosiatiivisen muistivalineen (2) , jolla 
jarjestetaan hakualueen sisaltamat kuvalohkot tallen- 
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tamalla kyseisten kuvalohkojen kuvalohkokeskiarvot ky- 
seisen assosiatiivisen muist ivalineen (2) hakemisto- 
muistin muistipaikkoihin nousevaan tai laskevaan jar- 
jestykseen, seka tallentamalla kyseisen hakemistomuis- 
tin kutakin muistipaikkaa vastaavaan antomuistin muis- 
tipaikkaan niiden kuvalohkojen si j aintit iedot , joiden 
kuvalohkokeskiarvo vastaa kyseiseen hakemistomuistin 
muistipaikkaan talletettua arvoa, ja jonka assosiatii- 
visen muistivalineen (2) avainsanana kaytetaan koodat- 
tavan kuvalohkon kuvalohkokeskiarvoa , 

valineet (3), joilla rajoitetaan kasiteltavi- 
en kuvalohkojen joukkoa keskimaaraisen virheen perus- 
teella # ja 

valineet (3) , joilla etsitaan kyseiseen ra- 
joitettuun joukkoon kuuluvista kuvalohkoista paras 
vaihtoehto PDE-menetelmaa kayttamalla. 
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(57) TIIVISTELMA 



Esilla olevan keksinnon kohtee- 



na on menetelma ja jarjestelma Hike- 
estimoinnin suorittamiseksi videokuvan 
kompressoinnissa . Keksinnon mukaisesti 
liike-estimoinnissa kaytetaan apuna as- 
sosiatiivista muistivalinetta , seka ra- 
joitetaan kasiteltavien kuvalohkojen 
joukkoa keskimaaraisen virheen perus- 
teella ja etsitaan kuvalohkoista paras 
vaihtoehto PDE-menetelman avulla. Kek- 
sinnon ansiosta liike-estimointi voidaan 
suorittaa ohjelmallisesti t avail isessa 
PC-ymparistossa, ja kuitenkin samanai- 
kaisesti aiempaa tehokkaammin . 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19J World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
4 January 2001 (04.01.2001) 




PCT 



(10) International Publication Number 

WO 01/01692 Al 



(51) International Patent Classification 7 : H04N 7/26, 7/34 

(21) International Application Number: PCT/FIOO/00586 

(22) International Filing Date: 28 June 2000 (28.06.2000) 

(25) Filing Language: Finnish 

(26) Publication Language: English 



(30) Priority Data: 
991469 



28 June 1999 (28.06. 1999) FI 



(71) Applicant (for all designated States except US): VAL- 
TION TEKNILLINEN TUTKIMUSKESKUS [FI/FIj; 
Vuorimiehentie 5, FIN-02150 Espoo (FI). 

(72) Inventor; and 

(75) Inventor/Applicant (for US only): VALLI, Seppo [FI/FI]; 
VTT Tietotekniikka, P.O. Box 1203, FIN-02044 VTT (FI). 

(74) Agent: PAPULA OY; P.O. Box 981, (Fredrikinkatu 61 A), 
FIN-00101 Helsinki (FI). 



(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CR, CU, CZ, 
DE, DK, DM, DZ, EE, ES, FI, GB, GD, GE. GH, GM, HR, 
HU, ID, EL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, LK, LR, 
LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, MZ, 
NO, NZ, PL, FT, RO, RU, SD, SE, SG, SI, SK, SL, TJ, TM, 
TR, TT, TZ, UA, UG, US, UZ, VN, YU, ZA, ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM. AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE), OAPI patent (BF, BJ, CF, CG, 
CI, CM, GA, GN, GW, ML, MR, NE, SN, TD, TG). 

Published: 

— With international search report. 

— Before the expiration of the time limit for amending the 
claims and to be republished in the event of receipt of 
amendments. 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: PROCEDURE AND SYSTEM FOR PERFORMING MOTION ESTIMATION 





^ 1 


PDE 


4 ► 



r 3 



V© 




o 



(57) Abstract: The present invention relates to a method and system for performing motion estimation in video image compression. 
In accordance with the invention, an associative memory device is used in motion estimation, and the group of the image blocks to 
be processed is restricted on the basis of a mean error and the best match is searched among the image blocks using the PDE method. 
Thanks to the invention, motion estimation may be performed via software in a regular PC environment and still more efficiently 
than before. 
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PROCEDURE AND SYSTEM FOR PERFORMING MOTION ESTIMATION 

FIELD OF THE INVENTION 

The invention relates to video image compres- 
sion. In particular, the invention relates to a new 
5 and advanced method and system of performing motion 
estimation in conjunction with video image compres- 
sion . 

PRIOR ART 

10 Previously known are several methods of video 

image compression. For most of the methods, motion es- 
timation is the stage demanding the most time and com- 
puting efficiency. The main principal of motion esti- 
mation is as follows. A video image consists of suc- 

15 cessive frames in a time level. Each frame is divided 
into image blocks of certain size. Typically a block 
is, e.g. the size of eight by eight pixels. When cod- 
ing a frame, e.g. for transmission it is being proc- 
essed block by block. However, instead of transmitting 

2 0 each block of each frame as such, an attempt is made 

to search from the previous frame, in the area of the 
image block being worked, in so called search area, a 
block either exactly matching with or in a certain 
scope close to the current block. In case this kind of 
25 image block is found, just the motion vector, i.e. 
vector denoting the location of the found block in re- 
lation to the original one is transmitted instead of 
transmitting the whole block of information. The 
amount of the information to be sent is thereby re- 

3 0 markably reducing. 

One other method used in conjunction with 
video compression is vector quantization. It differs 
from motion estimation in that the matching tag for 
the block to be coded is searched from a predetermined 
3 5 code book, instead of searching it from the previous 
frame. The code book is typically a group of most com- 
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monly appearing image blocks . The same code book is 
naturally used both for the encoders and decoders. 

Although using motion estimation and vector 
quantization remarkably helps to reduce the amount of 
5 the information to be transmitted, there are, however, 
certain problems associated with them. Typically, es- 
pecially the search phase is time-consuming. The com- 
plexity of search increases in relation to the square 
of the page length of the search area. Therefore, at- 

10 tempts have been made to develop different methods us- 
ing which the search may be made fastener. The follow- 
ing publications disclose examples of methods with the 
intent to fasten motion estimation and vector quanti- 
zation either by focusing on enhancing the search al- 

15 gorithms or using some other means: S. T. Valli, "Very 
Low Bitrate Coding Using Hierarchical Classified VQ 
and Cluster Based Segmentation of Motion Information", 
paper No. 7.3, VLBV94 , University of Essex, UK, April 
1994; H. Li, A. Lundmark, R. Forchheimer, "Image Se- 

20 quence Coding at Very Low Bitrates: A Review", IEEE 
Transactions on Image Processing, Vol.3, No. 5, Septem- 
ber 1994; H. Abut, ed . , "Vector Quantization", IEEE 
Press, 1990; G. Poggi , "Fast Algorithm for Full-Search 
VQ Encoding", Electronic Letters, Vol.29, No. 123, June 

25 1993; C.-M. Huang, Q. Bi , G. S. Stiles, R. W. Harris, 
"Fast Full Search Equivalent Encoding Algorithms for 
Image Compression Using Vector Quantization", IEEE 
Transactions on Image Processing, Vol.1, No. 3, July 
1992 . 

30 When using the present methods the search 

area is at maximum typically + 15 pixels of the point 
of origin of the block to be coded. And even in that 
case the search is so complex that carrying out it via 
software is generally speaking not even possible, in- 

35 stead expensive device-based solutions have to be 
used, such as specific signal processing circuits. 
However, shifts even bigger than the + 15 pixels -men- 
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tioned in conjunction with the applications of low 
transfer rate/low image frequency are common during 
the motion. Thus, there is a need for more efficient 
methods . 



disclose a method and system that would eliminate the 
drawbacks mentioned above. One specific objective of 
the invention is to disclose a method and system that 
makes it possible to perform motion estimation in a 
10 regular PC environment and at the same time more effi- 
ciently than before. 

SUMMARY OF THE INVENTION 



15 forming motion estimation in video image compression 
comprises the following stages. On frame N, an image 
block that is wished to be coded is determined. On 
frame N-l prior to the aforementioned frame N, a 
search area of motion vectors corresponding to the lo- 

20 cation of the block in question is determined. The 
image block average values are determined in every 
possible location area of the image blocks included in 
the aforementioned search area using a shift of prede- 
termined size. After this, based on the image block 

25 average values of the image blocks, the image blocks 
included in the aforementioned search area are ar- 
ranged in a predetermined order. Previously known is a 
method of performing the aforementioned arrangement by 
using different sorting algorithms. The disadvantage 

30 associated with the algorithms in question is, how- 
ever, their slowness. Next, an alternative best match- 
ing with the image block to be coded is searched among 
the image blocks of the search area in question. The 
maximum correspondence may be determined, e.g. using a 

3 5 minimum error, i.e. the blocks with the smallest error 
between them are best matching with each other. 



The objective of the present invention is to 



The method of the present invention for per- 
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The determining of the image block average 
values is used herein to mean that in a preferred 
case, the image block average values computed and 
stored already in connection with the coding of the 
5 previous image blocks are retrieved from a specific 
image block average value memory. This is possible be- 
cause the search area determined for the image block 
to be coded is typically partly the same as the search 
area corresponding to the previous coded image blocks 

10 for which the determining of image block average val- 
ues and storing in the memory in question has already 
happened. If however, motion estimation is not used in 
coding the previous image blocks or if the image block 
average value cannot be found in the aforementioned 

15 memory, so the image block average value is computed 
and stored in the memory in question. 

In the advantageous procedure presented above 
the image block average values of frame N-l are com- 
puted and stored as the image blocks of frame N are 

2 0 being coded. The image block average values may, how- 
ever, be computed and stored in one go before coding 
the image blocks. This is, however, not preferable be- 
cause motion estimation requiring computing of the im- 
age block average values is not necessarily performed 

2 5 in coding every image block. 

In accordance with the invention, the image 
blocks included in the search area are sorted by stor- 
ing the image block average values of the image blocks 
in question in the memory locations of the directory 

3 0 memory of an associative memory device in an ascending 

or descending order and by storing in the memory loca- 
tion of the output memory corresponding to each memory 
location of the directory memory the location data of 
the image blocks whose image block average value cor- 
35 responds to the value stored in the memory location of 
the directory memory in question. As a key word of the 
aforementioned associative memory device, the image 
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block average value of the image block to be coded is 
used. 

An associative memory device is used herein 
to mean a digital memory device, such as, e.g. a mem- 
5 ory chip in which the regular address coding logic has 
been substituted with a specific directory memory. The 
directory memory consists of memory locations with, 
e.g. a certain character string stored in each one of 
them. In addition, the associative memory device in- 

10 eludes output memory in the memory locations of which 
the actual data is typically stored. Each one of the 
memory locations of the output memory is associated 
-with one or more memory locations of the directory 
memory. A certain key word, which might be, e.g. a 

15 character string, is given to the memory to serve as 
an input . In case a matching tag with the key word is 
found in some memory location of the directory memory, 
as output is received the content of the memory loca- 
tion of the output memory corresponding to the memory 

2 0 location of the directory memory in question. An exam- 
ple of an associative memory device is CAM (Content 
Addressable Memory, CAM) . A more detailed description 
of an associative memory device can be found, e.g. in 
the publication T. Kohonen, "Self -Organization and As- 

25 sociative Memory", Springer-Verlag , 1984. 

Further in accordance with the invention, the 
group of the image blocks to be processed is re- 
stricted on the basis of a mean error in accordance 
with the following equation: 

30 Y A D.*}. in which 

Y A represents the restricted group of the im- 
age blocks to be processed, 

y s is the candidate block i, 

is the image block average value of the 

35 image block to be coded. 

is the image block average value of the 

candidate block i, and 
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D min is the error of the best candidate block 
per each pixel . 

D msn ma Y be computed, e.g. as an RMS error or 
5 as a MAD error (Root -Mean-Squared, RMS; Mean-Absolute- 
Distortion, MAD) . A more detailed description of re- 
striction on the basis of mean error can be found, 
e.g. in the aforementioned publications C.-M. Huang, 
Q. Bi, G. S. Stiles, R. W. Harris, "Fast Full Search 

10 Equivalent Encoding Algorithms for Image Compression 
Using Vector Quantization' 1 , IEEE Transactions on Image 
Processing, Vol.1, No. 3, July 1992 and G. Poggi, "Fast 
Algorithm for Full-Search VQ Encoding", Electronic 
Letters, Vol.29, No. 123, June 1993. 

15 Furthermore in accordance with the invention, 

the best match is searched among the blocks included 
in the restricted group of images in question by using 
the PDE method (Partial Distance Elimination, PDE) . 
PDE is a method known in itself, which is used, e.g. 

2 0 in vector quantization for fastening the search. The 

error between the image block to be coded and the can- 
didate block is computed normally pixel by pixel. If 
the error exceeds the minimum error up to that stage, 
the computing is stopped and the comparison is done in 
25 the next candidate block. 

In an embodiment of the invention, a prede- 
termined area of regular shape around the image block 
to be coded is used as search area. The search area is 
typically, e.g. the shape of a quadrangle. 

3 0 In an embodiment of the invention, an area is 

defined that is comprised of an area of one or more 
objects moving fast between successive image frames, 
and the said area is used as search area. 

In an embodiment of the invention, the possi- 
35 ble location areas are defined by using a shift of one 
pixel, a half of a pixel or some other fractional 
shift. 





WO 01/01692 



PCT/FI00/00586 



7 



The advantage of the present invention when 



10 



15 



20 



25 



30 



compared with the prior art is that it remarkably fas- 
tens motion estimation and thereby makes it possible 
to perform motion estimation via software in a regular 
PC environment and still more efficiently than before. 
Since motion estimation may be performed via software, 
there is no need for expensive device-based solutions, 
and therefore, by the aid of the invention, motion es- 
timation may be made more advantageous than before. 

LIST OF FIGURES 

In the following section, the invention is 
described by way of examples of its embodiments with 
reference to the attached drawing, wherein 

Fig. 1 represents a system of the invention 
described in a block diagram. 

DETAILED DESCRIPTION OF THE INVENTION 

Fig. 1 represents the components of a system 
of the invention. The system has been implemented, 
e.g. in a form of programmable components in a regular 
PC device. The system comprises means of determining 1 
using which the image block average values are deter- 
mined in the location areas of the image blocks in- 
cluded in the search area corresponding to the loca- 
tion of the image block to be coded, means of sorting 
2 using which the image blocks are sorted on the basis 
of their image block average values, and means of 
searching 3 using which an alternative best matching 
with the image block to be coded is searched among the 
image blocks. The means of determining 1 comprise an 
image block average value memory (not presented) , 
wherein the computed image block average values are 
stored and where they are retrieved from in case 
needed. In practice, the image block average value 
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memory may be, e.g. a certain part of the memory space 
of a PC device. 



comprises a CAM memory 2 by means of which the image 
5 blocks are sorted by storing their image block average 
values in the memory locations of the directory memory 
in an ascending or descending order and by storing in 
the memory location of the output memory corresponding 
to each memory location of the directory memory the 

10 location data of the image blocks whose image block 
average value corresponds to the value stored in the 
memory location of the directory memory in question. 
In practice, the CAM memory 2 is advantageously a cer- 
tain part of the memory space of a PC device, but it 

15 may be, e.g. a separate memory chip. Further in accor- 
dance with the invention, the system comprises means 3 
for restricting the group of the image blocks to be 
coded on the basis of a mean error, and means 3 for 
searching among the image blocks included in the re- 

20 stricted group of images the best match by using the 
PDE method. 



be coded is determined. On frame N-l prior to the 
aforementioned frame N, a search area of motion vec- 

25 tors corresponding to the location of the block in 
question is determined. The image block average values 
are determined in every possible location area of the 
image blocks included in the aforementioned search 
area using a shift of predetermined size, such as a 

30 shift of one pixel, a half of a pixel or some other 
fractional shift. After this, the image blocks in 
question are arranged in a predetermined order on the 
basis of their image block average values and an al- 
ternative best matching with the image block to be 

35 coded is searched among the image blocks of the search 
area in question. The maximum correspondence may be 
determined, e.g. using a minimum error, i.e. the 



In accordance with the invention, the system 



On frame N, an image block that is wished to 
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blocks with the smallest error between them are best 
matching with each other. 

In practice, the determining of image block 
average values happens by retrieving the image block 
5 average values computed and stored already in connec- 
tion with the coding of the previous image blocks from 
a specific image block average value memory. This is 
possible because the search area determined for the 
image block to be coded is typically partly the same 

10 as the search area corresponding to the previous coded 
image blocks for which the determining of image block 
average values and storing in the memory in question 
has already happened. If however, motion estimation is 
not used in coding the previous image blocks or if the 

15 image block average value cannot be found in the 
aforementioned memory for some reason or other, so the 
image block average value is computed and stored in 
the memory in question. 

In the advantageous procedure presented above 

2 0 the image block average values of frame N-l are com- 

puted and stored as the image blocks of frame N are 
being coded. The image block average values may, how- 
ever, be computed and stored in one go before coding 
the image blocks. This is, however, not preferable be- 
25 cause motion estimation requiring computing of the im- 
age block average values is not necessarily performed 
in coding every image block. 

In accordance with the invention, the image 
blocks are sorted by storing their image block average 

3 0 values in the memory locations of the directory memory 

of the CAM memory 2 in an ascending or descending or- 
der. Further, the location data of the image blocks 
whose image block average value corresponds to the 
value stored in the memory location of the directory 
35 memory in question is stored in the memory location of 
the output memory corresponding to each memory loca- 
tion of the directory memory. As a key word of the CAM 
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10 



15 



memory 2, the image block average value of the image 
block to be coded is used. As search area, a predeter- 
mined area of regular shape around the image block to 
be coded is used. The search area is, e.g. the shape 
of a quadrangle. Alternatively, the search area may be 
an area comprised of an area formed by one or more ob- 
jects moving fast between successive frames. 



the examples of its embodiments presented above, in- 
stead many variations are possible within the scope of 
the inventive idea defined by the claims. One such 
variation is the using of the present invention for 
the searching of matching image blocks between the im- 
ages of a pair of stereo images (the left-hand and 
right-hand image) . This procedure similar to motion 
estimation is described, e.g. in the publication I. 
Dinstein et al . , "On the Compression of Stereo Images: 
Preliminary Results", Signal Processing 17 (1989), s. 
373-382 . 



The invention is not restricted to 



WO 01/01692 



PCT/FIOO/00586 



11 

CLAIMS 

1. A method for performing motion estimation 
in video image compression, which method comprises 
the following stages : 
5 the image block to be coded is determined on 

frame N, 

the search area corresponding to the location 
of the image block in question is determined on frame 
N-l, 

10 the image block average values are determined 

in the location areas of the image blocks included in 
the search area in question by using a shift of prede- 
termined size , 

the image blocks included in the search area 

15 in question are arranged in a predetermined order on 
the basis of the image block average values of the im- 
age blocks in question. 

an alternative best matching with the image 
block to be coded is searched among the image blocks 

20 of the search area in question, character- 
ised in that the method further comprises the fol- 
lowing stages : 

the image blocks included in the search area 
are sorted by storing the image block average values 

25 of the image blocks in question in the memory loca- 
tions of the directory memory of an associative memory 
device in an ascending or descending order and by 
storing in the memory location of the output memory 
corresponding to each memory location of the directory 

3 0 memory the location data of the image blocks whose im- 
age block average value corresponds to the value 
stored in the memory location of the directory memory 
in question, 

as a key word of the aforementioned associa- 

35 tive memory device, the image block average value of 
the image block to be coded is used, 
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the group of the image blocks to be processed 
is restricted on the basis of a mean error, and 

the best match is searched among the image 
blocks included in the restricted group of images by 
5 using the PDE method. 

2. Method as defined in claim 1, char- 
acterised in that the method further comprises 
the stage : 

as search area, a predetermined area of regu- 
10 lar shape around the image block to be coded is used. 

3. Method as defined in claim 1, c h a r - 
acterised in that the method further comprises 
the following stages: 

an area is defined that is comprised of an 
15 area of one or more objects moving fast between suc- 
cessive image frames, 

and the said area is used as search area. 

4 . Method as defined in any one of claims 1 - 
3, characterised in that the method further 

20 comprises the following stage: 

the possible location areas of the image 
blocks are determined by using a shift of one pixel, a 
half of a pixel or other fractional shift. 

5. A system for performing motion estimation 
25 in video image compression, which system comprises: 

means of determining (1) by means of which 
the image block average values are determined in the 
location areas of the image blocks included in the 
search area corresponding to the location of the image 
3 0 block to be coded by using a predetermined shift on 
the image frame prior to the image frame including the 
image block to be coded in question, 

means of sorting (2) by using which the image 
blocks are sorted on the basis of the image block av- 
3 5 erage values of the image blocks in question, and 

means of searching (3) by using which the 
variant best matching with the image block to be coded 
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is searched among the image blocks, character- 
ised in that the system further comprises: 

an associative memory device (2) by means of 
which the image blocks included in the search area are 
5 sorted by storing the image block average values of 
the image blocks in question in the memory locations 
of the directory memory of the associative memory de- 
vice in question (2) in an ascending or descending or- 
der and by storing in the memory location of the out- 

10 put memory corresponding to each memory location of 
the directory memory the location data of the image 
blocks whose image block average value corresponds to 
the value stored in the memory location of the direc- 
tory memory in question, and the image block average 

15 value of the image block to be coded is used as a key 
word of the associative memory device (2) . 

means (3) for restricting the group of the 
image blocks to be coded on the basis of a mean error, 
and 

20 means (3) for searching the best match among 

the image blocks included in the restricted group of 
images by using the PDE method. 
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